Ultra-wideband control of smart streaming devices

ABSTRACT

Systems and methods for controlling a smart streaming device are disclosed herein. The smart streaming device is controlled based on a position of an ultra-wideband (UWB) device. Based on the position of the UWB device, one or more service events for the smart streaming device can be conducted. For example, a privacy mode of the smart streaming device can be enabled or disabled based on the position of the UWB device. In another example, a distance can be determined between the smart streaming device and the position of the UWB device. Based on the distance, an output configuration of the smart streaming device can be set, such as dynamically adjusting volume or text size on the smart streaming device.

CROSS-REFERENCE TO RELATED APPLICATION(S)

This application is related to U.S. patent application Ser. No. ______,filed Feb. 17, 2021, having Attorney Docket No. 134875-8033-US01, titled“ULTRA-WIDEBAND CONTROL OF SMART STREAMING DEVICES,” which is herebyincorporated by reference in its entirety.

TECHNICAL FIELD

The present disclosure is directed to the use of ultra-widebandcommunication technology to control smart streaming devices.

BACKGROUND

Ultra-wideband technology is a low energy level, short-range, highbandwidth radio communication technology. Ultra-wideband technologyallows for communications over a large portion of the radio spectrum. Anadvantage of ultra-wideband technology is that ultra-wideband technologydoes not interfere with conventional narrowband and carrier wavetransmissions in the same frequency band.

Ultra-wideband technology allows systems and devices employing thetechnology to determine “time of flight” of transmissions at variousfrequencies, which helps to overcome the problem of multipathpropagation, as at least some of the frequencies have a line-of-sighttrajectory.

BRIEF DESCRIPTION OF THE DRAWINGS

FIG. 1 is a block diagram illustrating an overview of devices on whichsome implementations can operate.

FIG. 2 is a block diagram illustrating an overview of an environment inwhich some implementations can operate.

FIG. 3 is a block diagram illustrating components which, in someimplementations, can be used in a system employing the disclosedtechnology.

FIG. 4 is a flow diagram illustrating processes used in someimplementations for transferring a call between an origin device and adestination device 401 b.

FIG. 5A is a flow diagram illustrating processes used in someimplementations for transferring one or more content items from anorigin device to a destination device.

FIG. 5B is a conceptual diagram illustrating some implementations fortransferring information between an origin device and a destinationdevice.

FIG. 6 is a flow diagram illustrating a process used in someimplementations for conducting a service event for a smart streamingdevice based on a position of an ultra-wideband remote device.

FIG. 7A is a flow diagram illustrating a process used in someimplementations for enabling or disabling a privacy mode for a smartstreaming device based on a position of an ultra-wideband remote device.

FIG. 7B is a conceptual diagram illustrating an ultra-wideband devicewithin a geofenced area according to some implementations of theinvention.

FIG. 7C is a flow diagram illustrating a process used in someimplementations for setting an output configuration for a smartstreaming device based on a position of an ultra-wideband remote device.

FIG. 7D is a flow diagram illustrating a process used in someimplementations for switching an active user profile based on a positionof an ultra-wideband remote device.

FIG. 7E is a flow diagram illustrating a process used in someimplementations for determining an intended device for a command basedon a position of an ultra-wideband remote device.

FIG. 7F is a conceptual diagram illustrating a selection of an intendeddevice for a command according to some implementations of the invention.

FIG. 8 is a flow diagram illustrating a process used in someimplementations for controlling an activation of an antenna of anultra-wideband remote device.

FIG. 9 is a flow diagram illustrating a process used in someimplementations for configuring a smart streaming device based on aposition of an ultra-wideband remote device.

The techniques introduced here may be better understood by referring tothe following Detailed Description in conjunction with the accompanyingdrawings, in which like reference numerals indicate identical orfunctionally similar elements.

DETAILED DESCRIPTION

Aspects of the present disclosure are directed to the use of anultra-wideband control device for personal computing devices, such assmart display, communication, and streaming devices. Ultra-widebandenabled devices can accurately determine the distance between onesending ultra-wideband enabled device and one receiving ultra-widebandenabled device, as well as determine an angle of arrival of the signalfrom the sending ultra-wideband device. In addition to determining thesevalues, ultra-wideband enabled devices can also use ultra-wideband as acommunication channel for transmitting data to other ultra-widebandenabled devices. The use of ultra-wideband technology allows for avariety of functions to be performed with regards to the control ofpersonal computing devices. Examples of these functions includetransferring communication sessions between personal computing devices,automatically controlling settings based on a position of theultra-wideband control device, transferring data from one personalcomputing device to another, among others. The use of ultra-widebandtechnology allows for easier communications between devices withoutinterfering with other communication frequencies and/or devices in thearea.

For example, a user can point an ultra-wideband control device at asmart streaming device or smart television that is displaying atelevision show. As used herein a “smart streaming device” can be anycomputing device capable of receiving and playing audio/visual contentfrom a remote source. The ultra-wideband control device establishes acommunication connection using ultra-wideband frequencies with the smartstreaming device or smart television. The user can then gesture theultra-wideband control device at a second smart streaming device orsmart television. The gesture establishes a communication connectionwith the second smart streaming device or smart television. After thecommunication connections with the first device and the second deviceare established, the ultra-wideband control device sends a command tothe second device. The command instructs the second device to begindisplaying the same television show that is being displayed on the firstdevice. Once the second device is displaying the same television show asthe first device, the ultra-wideband control device sends a command tothe first device. The command sent to the first device instructs thefirst device to stop displaying the television show. Additional detailson transferring content between two smart streaming devices using theultra-wideband control device are provided below in relation to FIG. 5.

In another example, a smart streaming device can be playing music. Thesmart streaming device can receive a location of an ultra-widebandcontrol device and an angle of arrival of a signal from theultra-wideband control device. The smart streaming device can thendetermine a location of the ultra-wideband control device relative tothe smart streaming device, including determining a distance separatingthe ultra-wideband control device and the smart streaming device. Thesmart streaming device can then dynamically adjust the volume of themusic based on the distance between the ultra-wideband control deviceand the smart streaming device. Additional details on controlling outputsettings of a smart streaming device based on a distance to theultra-wideband control device are provided below in relation to FIG. 7C.

In a further example, a user can point an ultra-wideband control deviceat a first smart streaming device, the first smart streaming deviceparticipating in a voice and/or video call. The ultra-wideband controldevice establishes a communication connection with the first smartstreaming device. The user then can gesture the ultra-wideband controldevice at a second smart streaming device. The ultra-wideband controldevice establishes a communication connection with the second smartstreaming device. After the communication connections with the firstdevice and the second device are established, the ultra-wideband controldevice sends a command to the second device that instructs the seconddevice to join the call that the first device is participating in. Oncethe second device has joined the call the first device is participatingin, the ultra-wideband control device sends a command to the firstdevice that instructs the first device to leave the call. Additionaldetails regarding transferring a call from one smart streaming device toanother can be found below in relation to FIG. 4.

In an additional example, a smart streaming device can conduct one ofvarious service events in response to determining a location of anultra-wideband control device. The smart streaming device can determinea distance between the smart streaming device and the ultra-widebandcontrol device. Based on the distance, the smart streaming device canexecute one or more service events for the smart streaming device. Insome implementations, based on the distance, the smart streaming devicecan set a sensitivity of an “air mouse,” or a sensitivity of a cursorcontrolled by motion of the ultra-wideband control device. In otherimplementations, the smart stream device may include a passivecommunication component that can receive ultra-wideband communicationsfrom the ultra-wideband control device while the smart streaming deviceis turned off. In response to receiving a command to activate the smartstreaming device from the ultra-wideband control device, the passivecommunication component can generate a signal to turn on the smartstreaming device. Additional details regarding conducting service eventsfor smart streaming devices can be found below in relation to FIGS. 6and 7A-7F.

In another example, a smart streaming device can enable a privacy modebased on a position of an ultra-wideband control device. In someembodiments, the smart streaming device determines if the position ofthe ultra-wideband control device is within a predefined geofenced area,such as within 3 meters of the smart streaming device. If theultra-wideband control device is within the geofenced area, the smartstreaming device enables a privacy mode, allowing a user of theultra-wideband control device to access otherwise restricted data, suchas profile settings, security settings, restricted content, and otherdata that would normally not be available to every potential user of theultra-wideband control device and/or the smart streaming device.Additional details regarding enabling and disabling a privacy mode for asmart streaming device can be found below in relation to FIGS. 7A and7B.

In yet a further example, a smart streaming device can dynamicallyswitch which user profile is active on the smart streaming device basedon identifying a user of an ultra-wideband control device. The smartstreaming device can determine a location of the ultra-wideband controldevice and capture image data or video data of the location of theultra-wideband control device using an integrated camera of the smartstreaming device or another camera associated with the smart streamingdevice. The smart streaming device then performs image recognition toidentify a user at the location of the ultra-wideband control device andcompares the identified user to a list of users associated with thesmart streaming device. If a match is found between the identified userand an associated user of the smart streaming device, an active profileof the smart streaming device is switched to the identified user.Additional details regarding dynamically switching a user profile for asmart streaming device can be found below in relation to FIG. 7D.

In an additional example, an ultra-wideband control device can be inproximity to multiple devices. Using the position of the ultra-widebandcontrol device and positions of the devices in proximity to theultra-wideband control device, it can be determined which of the devicesthe ultra-wideband control device intended to receive a command, such asa power-on command. The command is then routed to the intended recipientdevice and executed on the intended recipient device.

In another example, an ultra-wideband control device can determine whichantenna of a plurality of antennas should be used to transmitinformation to a smart streaming device. Signal strength data, angle ofarrival data, and other data being received from an ultra-widebandreceiver of the smart streaming device can be used by the ultra-widebandcontrol device to select the antenna to be used for transmittinginformation to the smart streaming device ultra-wideband receiver.Additional details for selecting an antenna for an ultra-widebandcontrol device can be found below in relation to FIG. 8.

In a further example, a smart streaming device can be configured basedon a position of an ultra-wideband control device. In someimplementations, a user can calibrate the smart streaming device toaccount for the position of the ultra-wideband control device. Bycalibrating the smart streaming device, it can be ensured that any inputreceived from the ultra-wideband control device is accurately received,such as input controlling a cursor on a display of the smart streamingdevice. Additional details regarding configuring a smart streamingdevice can be found below in relation to FIG. 9.

Several implementations are discussed below in more detail in referenceto the figures. FIG. 1 is a block diagram illustrating an overview ofdevices on which some implementations of the disclosed technology canoperate. The devices can comprise hardware components of a device 100that perform a variety of functions related to control of the device 100and allow for communication with an ultra-wideband control device.Device 100 can include one or more input devices 120 that provide inputto the Processor(s) 110 (e.g. CPU(s), GPU(s), HPU(s), etc.), notifyingit of actions. The actions can be mediated by a hardware controller thatinterprets the signals received from the input device and communicatesthe information to the processors 110 using a communication protocol.Input devices 120 include, for example, a mouse, a keyboard, atouchscreen, an infrared sensor, a touchpad, a wearable input device, acamera- or image-based input device, a microphone, or other user inputdevices.

Processors 110 can be a single processing unit or multiple processingunits in a device or distributed across multiple devices. Processors 110can be coupled to other hardware devices, for example, with the use of abus, such as a PCI bus or SCSI bus. The processors 110 can communicatewith a hardware controller for devices, such as for a display 130.Display 130 can be used to display text and graphics. In someimplementations, display 130 provides graphical and textual visualfeedback to a user. In some implementations, display 130 includes theinput device as part of the display, such as when the input device is atouchscreen or is equipped with an eye direction monitoring system. Insome implementations, the display is separate from the input device.Examples of display devices are: an LCD display screen, an LED displayscreen, a projected, holographic, or augmented reality display (such asa heads-up display device or a head-mounted device), and so on. OtherI/O devices 140 can also be coupled to the processor, such as a networkcard, video card, audio card, USB, firewire or other external device,camera, printer, speakers, CD-ROM drive, DVD drive, disk drive, orBlu-Ray device.

In some implementations, the device 100 also includes a communicationdevice capable of communicating wirelessly or wire-based with a networknode. The communication device can communicate with another device or aserver through a network using, for example, TCP/IP protocols. Device100 can utilize the communication device to distribute operations acrossmultiple network devices.

The processors 110 can have access to a memory 150 in a device ordistributed across multiple devices. A memory includes one or more ofvarious hardware devices for volatile and non-volatile storage, and caninclude both read-only and writable memory. For example, a memory cancomprise random access memory (RAM), various caches, CPU registers,read-only memory (ROM), and writable non-volatile memory, such as flashmemory, hard drives, floppy disks, CDs, DVDs, magnetic storage devices,tape drives, and so forth. A memory is not a propagating signal divorcedfrom underlying hardware; a memory is thus non-transitory. Memory 150can include program memory 160 that stores programs and software, suchas an operating system 162, ultra-wideband application 164, and otherapplication programs 166. Memory 150 can also include data memory 170,e.g., data allowing for the control of device 100 with an ultra-widebandcontrol device, configuration data, settings, user options orpreferences, etc., which can be provided to the program memory 160 orany element of the device 100.

Some implementations can be operational with numerous other computingsystem environments or configurations. Examples of computing systems,environments, and/or configurations that may be suitable for use withthe technology include, but are not limited to, personal computers,server computers, handheld or laptop devices, cellular telephones,wearable electronics, gaming consoles, tablet devices, multiprocessorsystems, microprocessor-based systems, set-top boxes, programmableconsumer electronics, network PCs, minicomputers, mainframe computers,distributed computing environments that include any of the above systemsor devices, or the like.

FIG. 2 is a block diagram illustrating an overview of an environment 200in which some implementations of the disclosed technology can operate.Environment 200 can include one or more client computing devices 205A-D,examples of which can include device 100. Client computing devices 205can operate in a networked environment using logical connections throughnetwork 230 to one or more remote computers, such as a server computingdevice.

In some implementations, server 210 can be an edge server which receivesclient requests and coordinates fulfillment of those requests throughother servers, such as servers 220A-C. Server computing devices 210 and220 can comprise computing systems, such as device 100. Though eachserver computing device 210 and 220 is displayed logically as a singleserver, server computing devices can each be a distributed computingenvironment encompassing multiple computing devices located at the sameor at geographically disparate physical locations. In someimplementations, each server 220 corresponds to a group of servers.

Client computing devices 205 and server computing devices 210 and 220can each act as a server or client to other server/client devices.Server 210 can connect to a database 215. Servers 220A-C can eachconnect to a corresponding database 225A-C. As discussed above, eachserver 220 can correspond to a group of servers, and each of theseservers can share a database or can have their own database. Databases215 and 225 can warehouse (e.g. store) information such as user settingsdata, profile data, user preference data, ultra-wideband control data,command data, and other data. Though databases 215 and 225 are displayedlogically as single units, databases 215 and 225 can each be adistributed computing environment encompassing multiple computingdevices, can be located within their corresponding server, or can belocated at the same or at geographically disparate physical locations.

Network 230 can be a local area network (LAN) or a wide area network(WAN), but can also be other wired or wireless networks. Network 230 maybe the Internet or some other public or private network. Clientcomputing devices 205 can be connected to network 230 through a networkinterface, such as by wired or wireless communication. While theconnections between server 210 and servers 220 are shown as separateconnections, these connections can be any kind of local, wide area,wired, or wireless network, including network 230 or a separate publicor private network.

Ultra-wideband (“UWB”) remote device 250 utilizes UWB radio technology,which is a short-range wireless communication protocol that operates atvery high frequencies (e.g., a broad spectrum of gigahertz frequencies).When a UWB device operates, the UWB device “ranges,” or calculatestime-of-flight of signals between the UWB device and responding devices.By using larger channel bandwidth (e.g., a channel bandwidth of 500megahertz) and short pulses (e.g., 1-2 nanoseconds for each pulse), theUWB device can achieve greater ranging accuracy than conventionaldevices. Because of the short pulse width and large channel bandwidth,UWB devices can track movement of the device in real-time, which allowsUWB devices to “understand” relative position and motion of the device.Additionally, UWB devices use angle-of-arrival technology to assist inproviding highly precise device location data of both the UWB devicesand other objects in the vicinity of the UWB devices. Therefore, UWBradio technology can be used to capture highly accurate spatial anddirectional data, such as providing data for determining a position ofthe UWB remote device 250 with an accuracy to the nearest centimeter ofthe actual position of the UWB remote device 250 in real time. UWBdevices can also determine whether an object is stationary, movingcloser to the UWB device, or moving away from the UWB device usingangle-of-arrival data and device location data.

The UWB remote device 250 can include one or more processors and one ormore communication devices, which may be similar to the processors 110and the communication device(s) described above with regards to FIG. 1.In some implementations, the communication devices of the UWB remotedevice 250 can include one or more UWB antennas. In someimplementations, a multiple-input multiple-output distributed antennasystem is employed in the UWB remote device 250. A multiple-inputmultiple-output distributed antenna system enables the use ofshort-range networking between the UWB remote device 250 and otherUWB-enabled devices. The multiple-input multiple-output distributedantenna system also increases the range of the UWB remote device 250 andensures more reliable signal reception at the UWB remote device 250. TheUWB remote device 250 can also include one or more inertial measurementunits (“IMUs”). The IMUs obtain inertial parameters of the UWB remotedevice 250 as it moves, such as attitude, position, and speedinformation.

The UWB remote device 250 can also include one or more user inputmechanisms. In some implementations, the user input mechanisms may bephysical input mechanisms, such as a button, switch, or the like. Inother implementations, the user input mechanisms may be an element of agraphical user interface (“GUI”), such as a virtual button or switch ona display. In some implementations, the UWB remote device 250 may be anidentification tag, an employee identification card, or the like. Insome implementations, the UWB remote device 250 may be a dedicatedremote control, a smart wearable, a mobile device, or the like.

The UWB remote device 250 can facilitate communication between one ormore of the client computing devices 205. In some implementations, theUWB remote device 250 acts as an intermediary device, receiving acommunication from an origin device of the client computing devices 205over a dedicated short-range communication connection between the origindevice and the UWB remote device 250. The UWB remote device 250 can thentransmit the communication over a second dedicated short-rangecommunication connection between the UWB remote device 250 and adestination device of the client computing devices 205. In otherimplementations, the UWB remote 250 does not directly receive andtransmit communications between devices, but rather indicates to theorigin device which destination device to communicate with and viceversa, over a separate communication channel (e.g., over bluetooth,WiFi, Zigbee, Z-wave, or the Internet connection of network 230).

Using ultra-wideband technology overcomes the shortcomings of othercommunications technologies. Existing communication technologies do nothave the accuracy, positioning capabilities, and radio frequencysecurity of ultra-wideband technology. For example, ultra-widebandtechnology's ranging capabilities are far superior to rangingcapabilities of existing communication technologies. Ultra-widebandtechnology also operates in bands of the radio spectrum away fromcurrently-congested bands near 2.4 gigahertz, which is used by manyconventional communication protocols.

Another significant advantage ultra-wideband technology has over othercommunication technologies is the use of a physical (“PHY”) layer tosend and receive data packets. Using the PHY layer, security techniquessuch as cryptography and random number generation can be employed tohelp protect communications, which other communication technologiescannot utilize. The bands of the radio spectrum ultra-widebandtechnology operates in and the enablement of security techniques canhelp prevent relay or man-in-the-middle attacks, where an actor canutilize a device to attempt to intercept authentication messages betweentwo devices. UWB technology ignores all other devices in the area.

Ultra-wideband technology also delivers greater accuracy inline-of-sight communication scenarios and stronger localization thanother communication technologies in non-line-of-sight communicationscenarios, which allows ultra-wideband technology to manage environmentsin which numerous obstacles would typically interfere with communicationsignals.

FIG. 3 is a block diagram illustrating components 300 which, in someimplementations, can be used in a system employing the disclosedtechnology. The components 300 include hardware 302, general software320, and specialized components 340. As discussed above, a systemimplementing the disclosed technology can use various hardware includingprocessing units 304 (e.g. CPUs, GPUs, APUs, etc.), working memory 306,storage memory 308 (local storage or as an interface to remote storage,such as storage 215 or 225), and input and output devices 310. Invarious implementations, storage memory 308 can be one or more of: localdevices, interfaces to remote storage devices, or combinations thereof.For example, storage memory 308 can be a set of one or more hard drives(e.g. a redundant array of independent disks (RAID)) accessible througha system bus or can be a cloud storage provider or other network storageaccessible via one or more communications networks (e.g. a networkaccessible storage (NAS) device, such as storage 215 or storage providedthrough another server 220). One or more of components 300 can beimplemented in a client computing device such as client computingdevices 205, on a server computing device, such as server computingdevice 210 or 220, or on a UWB device such as UWB device 250. Whileshown as being implemented in a single device, in some implementations,various of the components 300 can be implemented on different ones of aclient computing device 205, a server computing device 210 or 220, or aUWB device 250. In some implementations, different versions of any ofthe components 300 can be implemented on each of a client computingdevice 205, a server computing device 210 or 220, and/or a UWB device250.

General software 320 can include various applications including anoperating system 322, local programs 324, and a basic input outputsystem (BIOS) 326. Specialized components 340 can be subcomponents of ageneral software application 320, such as local programs 324.Specialized components 340 can include UWB communication software 344,meeting software 346, content item software 348, three-dimensionalcontrol software 350, privacy mode software 352, settings software 354,user profile software 356, calibration software 358, and componentswhich can be used for providing user interfaces, transferring data, andcontrolling the specialized components, such as interfaces 342. In someimplementations, components 300 can be in a computing system that isdistributed across multiple computing devices or can be an interface toa server-based application executing one or more of specializedcomponents 340. Although depicted as separate components, specializedcomponents 340 may be logical or other nonphysical differentiations offunctions and/or may be submodules or code-blocks of one or moreapplications.

UWB communication software 344 can interface with UWB hardware of I/O310 to facilitate communication between one or more smart streamingdevices and one or more UWB control devices, such as the UWB remotedevice 250. The UWB communication software 346 can receive commands fromthe UWB remote device 250, a position of the UWB remote device 250, andother information from the UWB remote device 250. The commands canprovide instructions for the one or more smart streaming devices, suchas commands to control the volume of the one or more smart streamingdevices or commands to transfer content between two different smartstreaming devices. The position of the UWB remote device 250 can be usedto control various functionality of the smart streaming device, such asdynamically controlling an audio output volume of the smart streamingdevice. Other data and information that can be received from the UWBremote device 250 can include various content items, identifiers ofother smart streaming devices, meeting information, securityinformation, and other data that can be communicated between two smartstreaming devices.

In some implementations, UWB communication software 346 can communicatewith other smart streaming devices by communicating data directly to areceiving smart streaming device(s). In other implementations, UWBcommunication software 346 can communicate data to the UWB remote device250 and an identifier of a destination smart streaming device. The UWBremote device 250 can then communicate the data to the identifieddestination smart streaming device, acting as an intermediarycommunication node between the two smart streaming devices. Additionaldetails on communications between the UWB remote device 250 and smartstreaming devices are provided below in relation to FIGS. 4-9 below.

Meeting software 346 allows a user to conduct virtual meetings using thesmart streaming device. For example, the meeting software 346 canconduct an audio and visual call allowing users to converse with one ormore other users of other smart streaming devices. Meeting software 346can include various functions associated with conducting theseaudio/video calls. Functionality can include functions for privatemeetings, such as generation of protected links that allow access to themeeting, generation of passwords, generation of meeting identificationcodes, and the like. The meeting software 346 can also control variousmeeting settings, such as the ability of a user of the smart streamingdevice to select an audio origin device (e.g., select a microphone touse for the meeting) and the ability of a user of the smart streamingdevice to select a video origin device (e.g., select a camera to use forthe meeting). Other meeting settings can include a self-mute feature forthe user of the smart streaming device, a share screen feature enablingthe user to share content being displayed on the smart streaming deviceto other participants in the call, a chat feature enabling the user ofthe smart streaming device to converse via text with other participantsin the call, and other meeting settings. Additional details onconducting virtual meetings on smart streaming devices are providedbelow in relation to FIG. 4.

Content item software 348 allows a user to view, modify, and otherwiseinteract with one or more content items. Content items can be socialmedia posts, pictures, videos, journalistic articles, audio files, wordprocessing documents, portable document format (“PDF”) documents,folders, uniform resource locators (“URLs”), text, and the like. In someimplementations, content item software 348 can present content items tothe user for viewing, allow a user to modify the content items (e.g.,edit a PDF), and perform other functionality related to the contentitems. In some implementations, content item software 348 organizes oneor more content items into a graphical user interface (“GUI”) thatallows a user to navigate, manage, and preview content items withoutopening the content items for display. For example, a list of availablecontent items can be presented to a user of the smart streaming device.The list of available content items is displayed in the GUI and caninclude additional details associated with each content item, such as anedit date of the content item, a source of the content item (e.g., anoriginal user who created the content item or a website where thecontent item can be accessed), and other metadata associated with eachcontent item. Additional details on interacting with one or more contentitems on a smart streaming device are provided below in relation to FIG.5.

Three-dimensional control software 350 allows a user to control a cursoron a display of a smart streaming device using the UWB remote device250. The smart streaming device receives gestures from the UWB remotedevice 250 as a series of x, y, z positions, optionally along withvelocity and acceleration information associated with the UWB remotedevice 250. Using these inputs, one or more processors of the smartstreaming device can interpret the positions into identified movements,e.g., to move the cursor around the screen or receive inputs, such asselections, from the UWB remote device 250 via one or more user inputmechanisms. For example, the user of the UWB remote device 250 maygesture the UWB remote device 250 at a content item being displayed onthe display of the smart streaming device and actuate a button on theUWB remote device 250. In response to the gesture, a cursor is movedover the content item being displayed at the smart streaming device. Thecontent item is then selected in response to the actuation of the buttonof the UWB remote device 250. When the content item is selected, it canbe displayed at the smart streaming device. The user of the UWB remotedevice 250 can then interact with the content item using one or moreadditional gestures, such as pointing the UWB remote device 250downwards to scroll down through the content item. Additional details oncontrolling a cursor on a display of a smart streaming device using theUWB remote device 250 are provided below in relation to FIGS. 4-9.

Privacy mode software 352 allows a user to restrict access to certaincontent items or settings when the user is associated with an activeprofile on the smart streaming device. An active profile is a userprofile of the smart streaming device that is currently in use.Restricted content items or settings can include such information asprivate profile information (e.g., password, personal information of theuser, and the like), sensitive information, or other information orcontent items the user wishes to keep private, such as age-restrictedcontent. To access the restricted content, various items of informationmay be necessary to input, such as providing a user name and password tothe smart streaming device. In some implementations, the UWB remotedevice 250 may be required to be within a certain distance orline-of-sight of a smart streaming device in order to enter the requireditems of information or may be required to be within a predefinedgeofenced area in the vicinity of the smart streaming device. Additionaldetails on enabling and disabling a privacy mode for a smart streamingdevice are provided below in relation to FIG. 7A.

Settings software 354 allows a user to save settings for use at one ormore smart streaming devices. For example, users can select displaythemes, initialization options (such as preset volume when the smartstreaming device is activated), favorite options, and various parametersof the smart streaming device, such as brightness, volume, default inputdevices, and other settings. In some implementations, the settings canthen be associated with a profile of the user at the smart streamingdevice for later use at the smart streaming device or at another smartstreaming device with a profile associated with the same user.Additional details on accessing and modifying settings for a smartstreaming device are provided below in relation to FIG. 7C.

User profile software 356 allows a user to save personal information toone or more smart streaming devices, such as the settings describedabove with regards to settings software 354. For example, a user cansave profile name information, password information, personal addressinformation, contact information, payment information, favorite contentitems, and the like to a memory associated with the smart streamingdevice. More than one user profile can be stored on each smart streamingdevice, and each user profile can have an associated settings, userinformation, and/or favorites that can be loaded and applied to a smartstreaming device when the user logs into the smart streaming device.Additional details on the use of user profiles on smart streamingdevices are provided below in relation to FIGS. 7A-7C.

Calibration software 358 can calibrate a smart streaming device to a UWBcontrol device, such as the UWB remote device 250. Calibration software358 can accomplish this by receiving input of a user pointing the UWBremote device 250 at indicated points a display screen associated withthe smart streaming device. This can enable the smart streaming deviceto identify how UWB position information corelates to where on thedisplay screen the UWB remote device 250 is pointing. Calibrating thesmart streaming device allows for an accurate detection of where on thedisplay screen the UWB remote device 250 is being pointed. Additionaldetails on calibrating a smart streaming device using the UWB remotedevice 250 are provided below in relation to FIG. 9.

Those skilled in the art will appreciate that the components illustratedin FIGS. 1-3 described above, and in each of the flow diagrams discussedbelow, may be altered in a variety of ways. For example, the order ofthe logic may be rearranged, substeps may be performed in parallel,illustrated logic may be omitted, other logic may be included, etc. Insome implementations, one or more of the components described above canexecute one or more of the processes described below. While some blocksdescribed below are described as optional and are shown in dotted linesin the corresponding figures, this does not mean that other blocks arerequired; but instead this calls attention to specific instances whereremovals of such blocks can occur.

FIG. 4 is a flow diagram illustrating processes 400 a, 400 b, and 400 cused in some implementations for transferring a call between an origindevice 401 a and a destination device 401 b. Process 400 a is a processassociated with a UWB device 403 (e.g., the UWB device 250), process 400b is a process associated with the origin device 401 a (e.g., one of theclient computing devices 205), and process 400 c is a process associatedwith the destination device 401 b (e.g., another of the client computingdevices 205). In some implementations, processes 400 a, 400 b, and 400 ccan be performed “just in time,” e.g. as a response to a user input onthe UWB remote 403. In some implementations, one or more of processes400 a, 400 b, and 400 c can be initialized: as part of a startupprocedure for the device that is executing that process, by an operatingsystem of that device, or as part of another program executed by thatdevice (e.g., by a voice calling program, a UWB companion application ordriver, etc.)

At block 402, process 400 a sends a first transition command to theorigin device 401 a and sends a second transition command thedestination device 401 b from the UWB remote device 403. The process 400a sends the transition commands to the origin device 401 a and thedestination device 401 b using UWB communication connections. In someimplementations, each of the origin device 401 a and the destinationdevice 401 b communicates with the UWB remote device 403 using adedicated UWB communication connection. In other implementations, theorigin device 401 a and the destination device 401 b communicate withthe UWB remote device 403 using the same UWB communication connectionand may also communicate with one another using the same UWBcommunication connection.

Determined directions at which the UWB device is pointed can be used toselect which devices are the origin device 401 a and the destinationdevice 401 b. For example, a user may be participating in a video callon one device and there may be two other devices in the user's home thatcan be joined to the call. The user can point the UWB remote device atthe device on which the video call is already connected to signal it asthe origin device 401 a, then the user may go into another room andpoint the UWB remote device at one of the other two devices to select itas the destination device 401 b. In some implementations, the transitioncommand is sent by the UWB remote device 403 first being pointed at theorigin device 401 a by a user, indicating the origin device 401 a as theorigin of outgoing data, and then pointing the UWB remote device 403 atthe destination device 401 b, indicating the destination device 401 b isto receive the outgoing data from origin device 401 a.

In some implementations, the user may also actuate a user inputmechanism on the UWB remote device 403 when pointing at the origindevice 401 a and then release the user input mechanism while the UWBremote device 403 is pointing at the destination device 401 b. Forexample, a user may press a button of the UWB remote device 403 whenpointing the UWB remote device 403 at the origin device 401 a to selectthe origin device 401 a as the source of outgoing data. The user thenholds down the button and gestures the UWB remote device 403 to point atthe destination device 401 b. The user then releases the button of theUWB remote device 403 once the UWB remote device 403 is pointing at thedestination device 401 b. The release of the button indicates that thedestination device 401 b is the destination for the data outgoing fromthe origin device 401 a. In other implementations, the user may actuateand release the user input mechanism of the UWB remote device 403 whenpointing at the origin device 401 a and then actuate and release theuser input mechanism again when pointing the UWB remote device 403 atthe destination device 401 b.

In other implementations, the transition command is sent when the UWBremote device 403 is moved away from the origin device 401 a and towardsthe destination device 401 b. For example, origin device 401 a anddestination device 401 b can be in different rooms. If a user carriesthe UWB remote device 403 from a room containing the origin device 401 ato a different room containing the destination device 401 b, thetransition commands are sent to the origin device 401 a and thedestination device 401 b. In this case, the UWB remote device mayidentify the origin device 401 a by determining that a device within afirst threshold distance is participating in a call. The UWS remotedevice may also select a destination device when the UWB remote deviceidentifies both that the UWB device has moved a second thresholddistance away from the origin device and/or has moved within a thirdthreshold distance of a device capable of joining the call.

In some embodiments, the user may actuate a user input mechanism of theUWB remote device 403 while moving in between the location of the origindevice 401 a and the location of the destination device 401 b. Forexample, the user may hold down a button of the UWB remote device 403while moving from the location near the origin device 401 a to thelocation near the destination device 401 b. Process 400 a identifies theorigin device 401 a when the button is first actuated at the location ofthe origin device 401 a. The process 400 a then waits for the button tobe released. When the button is released, process 400 a identifies thedestination device 401 b as the destination for the data from the origindevice 401 a.

In some implementations, the transition command only identifies theorigin device 401 a and the transition device 401 b to each other forperforming the transfer. For example, the UWB remote device 403 candetermine or receive an identifier for the origin device 401 anddetermine or receive an identifier for the destination device 401 b. TheUWB remote device 403 can then send the identifier of the destinationdevice 401 b to the origin device 401 a and send the identifier of theorigin device 401 a to the destination device 401 b.

In other implementations, the transition command includes additionalinformation for transferring the call. For example, the transitioncommand sent to the origin device 401 a can include an identifier of thedestination device 401 b. The transition command sent to the destinationdevice 401 b can include an identifier of the origin device 401 a andone or more credentials for accessing the call origin device 401 a iscurrently participating in, such as a call password, a call ID, aprotected or private link to the call, and the like.

In some implementations, the origin device 401 a sends credentials foraccessing the call to the UWB remote device 403, which then includes thecredentials for accessing the call in the transition command sent to thedestination device 401 b. In other implementations, the credentials maybe sent directly from the origin device 401 a to the destination device401 b over an UWB communication connection (e.g., based on the deviceidentifiers the UWB remote device 403 sent to each of the origin device401 a and the destination device 401 b).

At block 404, process 400 b receives the transition command at theorigin device 401 a. At block 404, the origin device 401 a is currentlyparticipating in a call. The call can be an audio call, a visual call,or a combination audio/visual (“AV”) call. The origin device 401 areceives the transition command and prepares to transition the call tothe destination device 401 b. In some implementations, the transitioncommand includes additional information for transitioning the call tothe destination device 401 b, such as an identifier of the destinationdevice 401 b.

At block 406, process 400 c receives the transition command at thedestination device 401 b. The destination device 401 b is not currentlyparticipating in the call with the origin device 401 a. The transitioncommand can include an identifier of the origin device 401 a andinformation related to the call the origin device 401 a is participatingin. The information related to the call can include a call ID, callparticipants, call duration, type of call, credentials for accessing thecall, such as a password or link to the call, etc.

In some implementations, the destination device 401 b is configured toidentify the call the origin device 401 a is participating in. Forexample, by using the identifier of the origin device 401 a, thedestination device 401 b can access a source of credentials that can beused to connect to the calendar, such as a digital calendar associatedwith the origin device 401 a. The calendar associated with the origindevice 401 a can include a meeting data object that is associated withthe call the origin device 401 a is currently participating in. Themeeting data object can include credentials for connecting to the call,such as a call ID, a call password, or a link to the call. The process400 c can obtain these credentials from the meeting data object and usethe credentials to connect to the call. In some implementations, thedestination device 401 b may be required to be logged into a useraccount associated with the calendar in order to access the calendar andany meeting data objects on the calendar. In other implementations, thetransition command sent from the UWB remote device 403 to thedestination device 401 b can include credentials or information that canbe used to access the calendar and the meeting data object.

At block 408, the process 400 c connects the destination device 401 b tothe call the origin device 401 a is currently participating in. Asdiscussed above, in some implementations, the destination device 401 buses credentials to access the call the origin device 401 a is currentlyparticipating in, such as a call ID, call password, or a link to thecall. The credentials can be obtained from the transition command orfrom another data source of credentials, such as a calendar associatedwith the origin device 401 a.

In some implementations, in addition to or as an alternative to needinga call ID and/or call password to access the call, the destinationdevice 401 b may be logged into a user profile associated with the userprofile logged in on the origin device 401 a. The user profile logged inon the destination device 401 b may be the same user profile and havethe same credentials as the user profile logged in on the origin device401 a that is participating in the call. In other implementations, theuser profile logged in on the destination device 401 b can be includedin a list of profiles or credentials known to be associated with theuser profile logged in on the origin device 401 a. Once the user who islogged in on the destination device 401 b is authorized to be on thecall, the destination device 401 b is connected to the call.

At block 410, the process 400 b identifies that the destination device401 b has connected to the call the origin device 401 a is currentlyparticipating in. The process 400 b monitors the call to detect when newparticipants join the call. In some implementations, the process 400 bmonitors the call to determine that the destination device 401 bspecified in the transition command received at block 404 has joined thecall. For example, process 400 b can monitor the call to identifywhether destination device 401 b has joined the call, such as bymatching the destination device identifier of the destination device 401b to a phone number, a device ID, an email address, or other uniqueidentifying information of a new participant to the call. Once theidentifier of the destination device 401 b is detected as being in thecall by the process 400 b, the process 400 b identifies that thedestination device 401 b has joined the call.

In other implementations, the process 400 c sends an indication to theprocess 400 b that the destination device 401 b has connected to thecall. For example, process 400 c may receive a confirmation that thedestination device 401 b has successfully connected to the call. Whenthe confirmation is received by process 400 c, process 400 c sends anindication (sent via the UWB device 403 or another connection betweenthe origin device 401 a and destination device 401 b) to the origindevice 401 a that the destination device 401 b has successfullyconnected to the call.

At block 412, in response to identifying that the destination device 401b has connected to the call, the process 400 b disconnects the origindevice 401 a from the call. In some implementations, the process 400 bmay send a disconnect command to a system executing the call, which thendisconnects the origin device 401 a from the call. In otherimplementations, a system executing the call identifies that both theorigin device 401 a and the destination device 401 b are participatingin the call, and disconnects the origin device 401 a. In furtherimplementations, when the destination device 401 b successfully connectsto the call, the process 400 c sends an indication to the process 400 bindicating that the destination device 401 b has connected to the calland the origin device 401 a can be disconnected from the call. Becausethe destination device 401 b is now connected to the call, the user cancontinue to participate in the call using the destination device 401 b.In some implementations, block 412 is skipped and both the origin device401 a and destination device 401 b continue to participate in the call.

FIG. 5A is a flow diagram illustrating processes 500 a, 500 b, and 500 cused in some implementations for transferring one or more content itemsfrom an origin device 501 a (e.g., one of the client computing devices205) to a destination device 501 b (e.g., another of the clientcomputing devices 205). In some implementations, processes 500 a, 500 b,and 500 c can be performed “just in time,” e.g. as a response to a userinput on a UWB remote 503 (e.g., UWB remote 250). In someimplementations, one or more of processes 500 a, 500 b, and 500 c can beinitialized: as part of a startup procedure for the device that isexecuting that process, by an operating system of that device, or aspart of another program executed by that device (e.g., by a mediadisplay program, a UWB companion application or driver, etc.)

At block 502, process 500 a selects the origin device 501 a and thedestination device 501 b. In some implementations, to select the origindevice 501 a, a user points the UWB remote 503 at a computing devicethat the user wishes to be the origin device 501 a. The origin device501 a includes content the user wishes to select to transfer. To selectthe destination device 501 b, the user then points the UWB remote 503 ata computing device the user wishes to be the destination device 501 b.The destination device 501 b is a computing device the user wishes totransfer content to.

In some implementations, the user must also actuate a user inputmechanism of the UWB remote 503 while pointing the origin device 501 aand the destination device 501 b to select the origin device 501 a andthe destination 501 b. For example, the user can first point the UWBremote device 503 at the origin device 501 a and actuate a button of theUWB remote device 503. While holding down the button, the user thengestures the UWB remote device 503 to point the UWB remote device 503 atthe destination device 501 b. The user then releases the button of theUWB remote device 503 while pointing the UWB remote device at thedestination device 501 b. The initial actuation of the button whilepointing at the origin device 501 a identifies the origin device 501 aas the source of outgoing data. The release of the button while pointingthe UWB remote device 503 at the destination device 501 b identifies thedestination device 501 b as being the destination for the data from theorigin device 501 a.

In other implementations, the user actuates a user input mechanism whilepointing the UWB remote device 503 at the origin device 501 a and thenreleases the user input mechanism while still pointing at the origindevice 501 a. The actuation and release of the user input mechanismwhile pointing the UWB remote device 503 at the origin device 501 aidentifies the origin device 501 a as the source of outgoing data. Theuser then gestures the UWB remote device 503 to point the UWB remotedevice 503 at the destination device 501 b. While pointing the UWBremote device 503 at the destination device 501 b, the user actuates theuser input mechanism and then releases the user input mechanism. Theactuation and release of the user input mechanism while pointing the UWBremote device 503 at the destination device 501 b identifies thedestination device 501 b as the smart streaming device to receive datafrom the origin device 501 a.

At block 504, the process 500 a receives a selection of one or morecontent items to transfer between the origin device 501 a to thedestination device 501 b. In some implementations, a display of theorigin device 501 a displays one or more content items. Content itemscan be, for example, social media posts, videos, images, articles, audiofiles, word processing documents, portable document format (“PDF”)documents, folders, uniform resource locators (“URLs”), text, and thelike. In other implementations, the selection of one or more contentitems can include selecting one or more configurations or settings to betransferred to the destination device 501 b, one or more personalidentification items to be transferred to the destination device 501 b,and other information to be transferred between two smart streamingdevices.

In some implementations, a user can point the UWB remote device 503 atone or more of the displayed content items to select one or more of thecontent items. In some implementations, in order to select the contentitems, the user may also actuate a user input mechanism of the UWBremote 503 while pointing at the content item(s). For example, one ormore content items may be displayed in a GUI on the display associatedwith the origin device 501 a. The user can point the UWB remote device503 at a content item (or an icon representing a content item) of theone or more content items and press a button of the UWB remote device503. When the button is pressed, the content item is selected.

In other implementations, content items may be selected via a GUI beingdisplayed on a display associated with the origin device 501 a and oneor more user input mechanisms on the UWB remote 503. For example, theGUI may be displayed on the origin device 501 a. The user may then useone or more user input mechanisms on the UWB remote 503 to navigatethrough the GUI and one or more other user input mechanisms on the UWBremote 503 to select one or more content items from the GUI. Forexample, a user may use a track pad or lever of the UWB remote device503 to navigate vertically through a list of content items displayedwithin the GUI, highlighting each content item in turn each time a swipeis performed on the track pad or the lever is actuated. The user maythen use a button of the UWB remote device 503 or tap the track pad toselect the highlighted content item.

In some implementations, actions of blocks 502 and 504 may be combined.For example, the origin device 501 a and the content item can beselected with the same user action via the UWB device 503. In this case,for example, the user may point the UWB device 503 at a photo displayedon a device to both select that device as the origin device 501 a andselect that photo as the selected content item. As another example, thedestination device 501 b a destination location of the destinationdevice 501 b can be selected with the same user action via the UWBdevice 503. In this case, for example, after the user selected thecontent item on the origin device 501 a, the user may point the UWBdevice 503 at a particular location on a device to both select thatdevice as the destination device 501 b and to trigger a rule associatedwith the location on the destination device specifying how to handlereceiving the content item. Such rules, for example, can define for atype of the content item and/or a location on a display of thedestination device 501 b, what action to perform for the receivedcontent item. For example, the rules can define an application toexecute to display the content item (such as an application indicated atthe location of the destination device 501 b), a location to store thereceived content item (such as a folder indicated at the location of thedestination device 501 b), a social media or communication action totake (e.g., a type of the content item can be mapped to a way to postthe content item to social media, a person to send the content item to,or a message to send to a corresponding person), or various combinationsof these.

At block 506, the process 500 a sends transfer commands to the origindevice 501 a and the destination device 501 b using the UWB remotedevice 503. In some implementations, the UWB remote device 503 sends thetransfer command to the origin device 501 a over an UWB communicationconnection and sends the transfer command to the destination device 501b over a separate UWB communication connection. In otherimplementations, the UWB remote device 503 sends the transfer commandsto the origin device 501 a and the destination device 501 b over thesame UWB communication connection. In some implementations, the transfercommand sent to the origin device 501 a includes an identifier of thedestination device 501 b and/or an identifier of the content item(s)selected to transfer. In other implementations, the transfer commandsent to the origin device 501 a only provides an identifier of thecontent item(s) selected to transfer. In some implementations, thetransfer command sent to the destination device 501 b includes anidentifier of the origin device 501 a. In other implementations, thetransfer command sent to the destination device 501 b includes anidentifier of the origin device 501 a and an identifier of the contentitem(s) to be transferred to the destination device 501 b. Theidentifier of the content item(s) can be used to verify that all of theselected content item(s) have been transferred, as described below withregards to block 514.

At block 508, the process 500 b receives the transfer command at theorigin device 501 a. The transfer command received at the origin device501 a can include an identifier of the content items(s) to transferand/or identifying information of the destination device 501 b, such asan identifier of the destination device 501 b.

At block 510, the process 500 c receives the transfer command at thedestination device 501 b. The transfer command received at thedestination device 501 b can include identifying information of theorigin device 501 a and can also include an identifier of the contentitem(s) to be received from the origin device 501 a. In someimplementations, the transfer command is received at the origin device501 a and the destination device 501 b simultaneously. In someimplementations, a transfer command is only sent to the origin device501 a and process 500 c does not perform block 510.

At block 512, the processes 500 b and 500 c establish a communicationchannel between the origin device 501 a and the destination device 501b. In some implementations, the communication channel is establisheddirectly between the origin device 501 a and the destination device 501b using a UWB, WiFi, bluetooth, NFC, Internet, or other networkcommunication connection. In other implementations, the communicationchannel is established with the UWB remote device 503 as an intermediarydevice. For example, the process 500 b can establish an UWBcommunication connection between the origin device 501 a and the UWBremote device 503. The process 500 c can also establish an UWBcommunication connection between the destination device 501 b and theUWB remote device 503. In these implementations, the UWB remote device503 first receives the selected content item(s) from the origin device501 a. Process 500 a then transmits the selected content item(s) to thedestination device 501 b.

At block 514, the process 500 b sends the selected content item(s) fromthe origin device 501 a through the established communication channel tothe destination device 501 b. In some implementations, the UWB remotedevice 503 acts as an intermediary device, and therefore receives theone or more content items from the origin device 501 a before sendingthe one or more content items on to the destination device 501 b.

At block 516, the process 500 c receives the selected content item(s) atthe destination device 501 b. In some implementations, the destinationdevice 501 b can store the content item(s) for later use or display,such as storing the content item(s) in a memory associated with thedestination device 501 b. In other implementations, the destinationdevice 501 b can display the one or more content items on a displayassociated with the destination device 501 b immediately upon receivingthe content item(s). In some embodiments, the process 500 c can takeadditional actions associated with the content item(s), such asautomatically playing video or audio files. In further implementations,if the content item(s) includes a configuration file for the destinationdevice 501 b, the destination device 501 b can immediately initiate orexecute the configuration file to change one or more configurationsettings on the destination device 501 b, such as changing a defaultstart-up volume of the destination device 501 b. As discussed above, thetype of the content item and/or where on the destination device 501 bthe content item was dropped by the transfer command can trigger one ormore rules that map to additional actions such as how to display orstore the content item, where to post the content item, how to share thecontent item, what other communication session to setup, etc.

In some implementations, the UWB remote device 503 can receive meetinglog-in credentials as the content item(s). The process 500 b sends, viathe UWB remote device 503, meeting credentials from the origin device501 a to the destination device 501 b. Once the process 500 c hasreceived the meeting credentials at the destination device 501 b, theprocess 600 c can invoke a corresponding rule to connect the destinationdevice 501 b to the meeting and initiate an audio and/or video feed fromthe destination device 501 b to the meeting to allow the user toparticipate in the meeting.

In other implementations, the process 500 c can receive accountinformation or user information as the content item(s). The process 500c can then invoke a rule to use the account information or the userinformation to perform various functions at the destination device 501b. The functions can include logging a user into the destination device501 b, applying one or more favorite settings associated with the userto the destination device 501 b, displaying a favorite content item(s)of the user on a display associated with the destination device 501 b,and other functions.

FIG. 5B is a diagram illustrating an environment 550 used in someimplementations for transferring information between an origin device,such as origin device 401 a or 501 a, and a destination device, such asdestination device 401 b or 501 b. As described above with regards toFIG. 4 and FIG. 5A, the UWB remote device 403 or 503 can be pointed atorigin device 401 a or 501 a by a user of the UWB remote device 403 or503. The UWB remote device 403 or 503 communicates with the origindevice 401 a or 501 a over a UWB communication connection. Data can becommunicated over the UWB communication connection between the origindevice 401 a or 501 a and the UWB remote device 403 or 503. For example,the UWB remote device 403 or 503 can identify the origin device 401 a or501 a as the computing device from which data will transfer.

The user of the UWB remote device 403 or 503 then performs a gesture 555to point the UWB remote device 403 or 503 at destination device 401 b or501 b. Much like when the UWB remote device 403 or 503 is pointed at theorigin device 401 a or 501 a, the UWB remote device 403 or 503communications with the destination device 401 b or 501 b over a UWBcommunication connection. The UWB remote device 403 or 503 can thenidentify the destination device 401 b or 501 b as the computing deviceto which data will be transferred. A communication channel can beestablished between these devices and a selected content item or callinformation can be transferred. Where call information is transferred,the destination device 401 b can join the call, causing the origindevice 401 a to leave the call.

FIG. 6 is a flow diagram illustrating a process 600 used in someimplementations for conducting a service event for a smart streamingdevice (e.g., one of devices 205) based on a position of the UWB remotedevice (e.g., UWB remote device 250). In some implementations, process600 can be performed as a response to a user input on the UWB remote250. In other implementations, the process 600 begins when the smartstreaming device is activated, and sits idle or “in the background”until a triggering event, such as the UWB remote 250 coming within athreshold distance of the smart streaming device, occurs. When thetriggering event occurs, the process 600 executes.

At block 602, the process 600 determines a position of the UWB remotedevice. UWB technology allows for the smart streaming device todetermine the position of the UWB remote device by determining adistance between the smart streaming device and the UWB remote deviceand an angle of arrival of the signal to the smart streaming device fromthe UWB remote device. Using the distance and the angle of arrival, aposition of the UWB remote device relative to the smart streaming devicecan be determined.

At decision block 604, the process 600 can optionally determine if atriggering condition for the service event has occurred. The triggeringcondition can be receiving a button press from the UWB remote device(e.g., a power button or other button), receiving an interaction fromthe UWB remote device with a GUI on the smart streaming device (e.g.,selecting a content item presented within the GUI), receiving a voicecommand, and the like. In some implementations, no triggering event isrequired, and the process 600 automatically proceeds to conducting aservice event as described below with regards to block 606 after theposition of the UWB remote device is determined.

If the triggering condition has not occurred (“No” at decision block604), the process 600 returns to waiting for the triggering condition tooccur. In some implementations, the process 600 can continue to detectthe position of the UWB remote device while awaiting the triggeringcondition, or continuously detect the position the UWB remote device,including detecting changes in the position of the UWB remote device. Inother implementations, the process 600 can re-determine the position ofthe UWB remote device as described with regards to block 602 once thetriggering condition occurs.

At block 606, and optionally once the triggering condition occurs (“Yes”at decision block 604), the process 600 conducts a service event. Theservice event can be one of a variety of functions available to thesmart streaming device.

For example, an “air mouse sensitivity” may be adjusted based on thedistance between the UWB remote device and the smart streaming device.An air mouse allows a user to control a cursor on a display of the smartstreaming device using hand gestures performed by the user holding theUWB remote device. For example, the cursor can be positioned at a pointon the display that the user of the UWB remote device is pointing theUWB remote device at. In some implementations, the UWB remote devicemust be in a hand performing the gesture. Based on the distance betweenthe UWB remote device and the smart streaming device, the sensitivity ofthe air mouse may be altered. For example, the closer the UWB remotedevice is to the smart streaming device, the lower the sensitivity canbe, which requires larger gestures to move a cursor on the display ofthe smart streaming device. In contrast, the farther the UWB remotedevice is from the smart streaming device, the higher the sensitivitycan be, which means smaller movements are required to move the cursorthe same distance across the display.

Another example of a service event is allowing three-dimensional controlof the smart streaming device with the UWB remote device. The positionof the UWB remote device can include data tracking rotations andmovements in x, y, and z axes. The service event can take these inputsin all three axes and interpret the inputs into a movement in a userinterface on a display of the smart streaming device, enablingthree-dimensional control input for showing new screen effects andcreating new possibilities for gaming applications. In someimplementations, different actions or controls can be mapped to variousUWB remote device positions. In one implementation, a user may raise theUWB remote device to point straight up in the air. In response, thedisplay may scroll upwards to show different content than is currentlydisplayed, transition to a new view of a GUI, or navigate through avertical list of content items. In another implementation, the user maymake a gesture, such as moving the hand holding the UWB remote device,in a circular motion. In response to detecting the circular motionmovement, the smart streaming device may increase an output volume ordecrease an output volume, or may highlight or draw a circle graphicaround a particular content item the user is “drawing” the circle aroundon the GUI.

In other implementations, the smart streaming device can be activated asa service event. For example, the smart streaming device, even when inan “off” state, may have at least one passive communication componentoperating to detect the UWB remote device and receive commands from theUWB remote device. When the UWB remote device is pointed at the smartstreaming device while the smart streaming device is in the “off state”,the smart streaming device can switch to an “on state”, or operatingstate. Optionally, when the UWB remote device is pointed at the smartstreaming device, the user of the UWB remote device can be required topush a power button or actuate some other user input mechanism to switchthe smart streaming device to the “on state.”

Additional details regarding particular service events that can beconducted are described with regards to FIGS. 7A-F.

FIG. 7A is a flow diagram illustrating a process 700 used in someimplementations for enabling or disabling a privacy mode for a smartstreaming device based on a position of the UWB remote device (e.g., UWBremote device 250).

At block 702, the process 700 determines a position of the UWB remotedevice. Much like block 602 of FIG. 6, an angle of arrival and distanceof the UWB remote device in relation to the smart streaming device isused to determine a position of the UWB remote device within a vicinityof the smart streaming device.

At decision block 704, the process 700 can optionally detect atriggering condition. The triggering condition can optionally bedetected much like the triggering condition associated with decisionblock 604 of FIG. 6, such as detecting an actuation of a user inputmechanism of the UWB remote device or receiving a voice command.

At decision block 706, and optionally once the triggering conditionoccurs (“Yes” at decision block 604), the process 700 determines if theposition of the UWB remote device is within a geofenced area. Thegeofenced area is a virtual area associated with the smart streamingdevice. In some implementations, the size and position of the geofencedarea can be a preset size and position set in a vicinity of the smartstreaming device, such as a defined rectangular area located one meterin front of the smart streaming device. The defined area can also be aroom the smart streaming device is located in, a building the smartstreaming device is located in, or another area. In otherimplementations, the geofenced area can be a defined area surroundingthe smart streaming device, such as a circular area of one meter inradius around the smart streaming device. In further implementations thegeofenced area can be set and/or adjusted by a user of the smartstreaming device. For example, the user may use the UWB remote device tointeract with a GUI displayed on a display associated with the smartstreaming device. The GUI can include controls that allow the user toset an area as the geofenced area, such as setting a length and width ofthe geofenced area and a location of the geofenced area relative to thesmart streaming device.

If the UWB remote device is located within the geofenced area (“Yes” atdecision block 706), the process 700 proceeds to block 708 where itenables a privacy mode of the smart streaming device. The privacy modeallows heightened user access to the smart streaming device, such asbeing able to access user settings and configurations files. Forexample, a user may only be able to edit configuration files of thesmart streaming device when the privacy mode is enabled. When theprivacy mode is enabled, a user can also access profile information thatmay be otherwise private (such as user name, password, securityquestion, and account recovery information), access additional profilefeatures (e.g., being able to make a call from the smart streamingdevice), access otherwise restricted content (such as age-controlledcontent), and the like.

In some implementations, when the UWB remote device is within thegeofenced area, an additional verification step may be needed to confirmthat the user of the UWB remote device should be accessing the privacymode of the smart streaming device. In some implementations, theadditional verification step can include entering a password, saying apass phrase voice command, entering a pass code, and the like. In someimplementations, the user is prompted by the smart streaming device (viaan audio command, a graphical component of a GUI, or a similar prompt)to enter this additional information to access the privacy mode andcomplete the additional verification step.

In some embodiments, only a subset of user profiles saved on the smartstreaming device can access the privacy mode. If the user attempting toaccess the privacy mode is not associated with a user profile within thesubset, the user will not be allowed access to the privacy mode. Thesubset of user profiles able to access the privacy mode can be modifiedby users with administrative privileges on the smart streaming device orcan be edited by accessing a configuration file defining the subset withparticular access credentials.

If the UWB remote device is not located within the geofenced area (“No”at decision block 706), the process 700 continues to block 710 where itdisables the privacy mode of the smart streaming device. By disablingthe privacy mode, a user of the smart streaming device will not be ableto access settings and configurations files, access profile informationthat may be otherwise private, access additional profile features (e.g.,being able to make a call from the smart streaming device), accessotherwise restricted content, and the like.

FIG. 7B is a conceptual diagram 711 illustrating a UWB remote device(e.g., UWB remote device 250) within a geofenced area 712 according tosome implementations of the invention. As described above, the geofencedarea 712 can be a defined area, such as a rectangular area, in thevicinity of smart streaming device 713. In other implementations, thegeofenced area 712 can be a different shape and a different size and canbe located at different locations relative to the smart streaming device713.

If the UWB remote device is located within the geofenced area 712 (atfirst location 714), a privacy mode of the smart streaming device 713 isenabled, allowing the user of the UWB remote device to access featuresof the smart streaming device 713 that are accessible only when theprivacy mode is enabled. In contrast, if the UWB remote device islocated outside the geofenced area 712, such as second location 715, theprivacy mode of the smart streaming device 713 is disabled. If theprivacy mode is disabled, the features of the smart streaming 713 thatare accessible only when the privacy mode is enabled are not accessibleto the user of the UWB remote device.

FIG. 7C is a flow diagram illustrating a process 720 used in someimplementations for setting an output configuration for a smartstreaming device based on a position of a UWB remote device (e.g., UWBremote device 250).

The process 720 determines the position of the UWB remote device as inblock 702 of FIG. 7A and then may optionally wait for a triggeringcondition to occur such as in decision block 704 of FIG. 7A.

At block 722 and, where block 704 is performed, in response to thetriggering condition occurring, the process 720 determines the distancebetween the UWB remote device and the smart streaming device. In someimplementations, the process 720 uses the position of the UWB remotedevice obtained at block 702 to determine the distance, as the distancebetween the UWB remote device and the smart streaming device is onecomponent of the position of the UWB remote device. In otherimplementations, the process 720 re-determines the distance to the UWBremote device. In one example, the process 720 can use a signal strengthbetween the UWB remote device and the smart streaming device todetermine a distance between the UWB remote device and the smartstreaming device.

At block 724, the process 720 accesses one or more mappings of distancesto output configurations. The one or more mappings can be stored in amemory of the smart streaming device. The mappings include outputconfiguration settings for the smart streaming device, such as displayresolution, brightness, video source, audio volume, audio source, andthe like. Each mapping can correspond to one or more distances or rangesof distances. For example, if the UWB remote device is one meter awayfrom the smart streaming device, a mapping associated with one meter canbe accessed. In another example, if the UWB remote device is one meteraway from the smart streaming device, a mapping associated with a rangeof zero to two meters can be accessed. The mappings may be linear ornon-linear. For example, if the mapping is linear, for every 0.5 metersthe UWB remote device is away from the smart streaming device, the audiovolume of the mapping is increased by one step. In another example, ifthe mapping is non-linear, the volume may increase by one step for thefirst 0.5 meters the UWB remote device is away from the smart streamingdevice, increase by two steps for the next 0.5 meters the UWB remotedevice is away from the smart streaming device, and so on.

Other factors may be considered in the selection of the mapping. Forexample, an amount of ambient light in a space containing the smartstreaming device can be used in addition to the distance between the UWBremote device to determine which mapping(s) to access. The other factorscan be gathered by the smart streaming device, such as determining anamount of ambient light in the space using a camera of the smartstreaming device. Based on these additional factors, the mapping can beselected. For example, based on the amount of ambient light in the spacecontaining the smart streaming device and the distance between the UWBremote device and the smart streaming device, a display brightness forthe smart streaming device can be selected.

In some implementations, the mappings may be further be selected basedon a user profile. For example, if the user associated with the UWBremote device is hearing impaired in one ear, audio volume controls inthe mappings may be modified to enable the user to hear, such as havingan increased audio volume even at short distances. In oneimplementation, the user can set, select, and/or modify these mappingsto fit the user's needs, such as modifying a volume mapping to haveincreased volume at all distances to compensate for hearing impairmentof the user. In some implementations, the user can select one or moremappings from an available set of mappings, the available set ofmappings including mappings that take into account various needs ofusers.

At block 726, the process 720 sets an output configuration of the smartstreaming device based on the accessed mapping(s). For example, if themapping for “distance is one meter or less” is accessed, settingsassociated with the mapping are applied to the smart streaming device,such as lowering an audio volume and reducing a brightness of a displayscreen of the smart streaming device. In another example, if the mappingfor “distance is 3 meters or greater” is accessed, setting associatedwith the mapping are applied to the smart streaming device, such asincreasing an audio volume, enlarging a video display portion of thedisplay, and the like.

In some implementations, the output configuration may include settingcontent and font size dynamically based on the distance between thesmart streaming device and the UWB remote device. For example, if theuser is two meters away from the smart streaming device, content and/orfont displayed on the display of the smart streaming device may bedisplayed at a true size, or original size of the content and/or font.As the UWB remote device is moved further away from the smart streamingdevice, the content and/or font may be enlarged in size. As the UWBremote device is moved closer to the smart streaming device, the contentand/or font may be reduced in size. In some implementations, apre-defined scale is used to define a relationship between the distanceseparating the UWB remote device and the smart streaming device and thesize of the content and/or font. For example, for every meter ofdistance between the UWB remote device and the smart streaming device,the content and/or font may be scaled up in size by one step (e.g., onefont size).

In some implementations, the process 720 can associate the UWB remotedevice with one or more microphones. In these implementations, theposition of the UWB remote device can be used to track a distancebetween a microphone of the one or more microphones and a speaker of thesmart streaming device. Using the distance, the process 720 candetermine travel time of sound from the speaker to the microphone. Theprocess 720 can then use this information along with an audio returnchannel of the speaker to cancel any echo caused by the microphone bybuffering input from the microphone and using the buffered input fordelayed echo cancellation. For example, the speed of sound isapproximately 340 meters per second. Using this number and a distancemeasurement to the microphone, the process 720 can determine that itwill take 15 milliseconds for the speaker sound to reach the microphone.By accounting for this in the buffered input, echo can be cancelled. Insome implementations, the process 720 can alternately configure audiooutput based on the UWB device position. For example, the smartstreaming device can have an array of speakers for directed audio outputwhere which speakers are activated and at which level can direct theaudio from the speaker array to particular locations. The process 720can cause this speaker array activation to direct the audio at thelocation of the UWB device.

FIG. 7D is a flow diagram illustrating a process 730 used in someimplementations for switching an active user profile based on a positionof a UWB remote device (e.g., UWB remote device 250).

The process 730 determines the position of the UWB remote device as inblock 702 of FIG. 7A and then may optionally wait for a triggeringcondition to occur such as in decision block 704 of FIG. 7A.

At block 732 and, where block 704 is performed, in response to thetriggering condition occurring, the process 730 receives an image of theuser of the smart streaming device, e.g., via a camera connected to thesmart streaming device. At block 734, the process 730 matches at least aportion of the image received at block 732 to the position of the UWBremote device determined at block 702. This allows the process 730 todetermine which portion of the image corresponds to the UWB device, andthereby which portion of the image is depicting a user holding the UWBdevice. Process 730 can accomplish this by determining the spatialorientation of the camera, e.g., based on a previous calibration processwhereby a user displayed to the camera an object of known dimensions,such spatial relationships can be determined as a comparison to theknown dimensions. In some implementations, the camera can include anarray of cameras or a depth camera, allowing accurate spatialorientation with or without the calibration process. Process 730 canthen determine how that spatial orientation of the camera compares tothe position data of the UWB device determined at block 702. Forexample, process 730 can map the image and the UWB position into a 3Dcoordinate system to determine how the UWB position relates to thecaptured image.

At block 736, the process 730 uses one or more facial recognitionalgorithms, such as machine learning based systems, to perform userrecognition on the portion of the image determined at block 734. If theprocess 730 does not recognize the user, no further action is taken orthe current user is notified that they cannot be recognized.

At block 738, the process 730 switches an active profile of the smartstreaming device to the user recognized at block 736 as corresponding tothe position of the UWB device. When the active profile is switched, theuser becomes the active profile on the smart streaming device, whichallows the user to access various functions. For example, having theactive profile allows the user to access settings associated with theprofile, favorite content associated with the profile, preferencesassociated with the profile, and the like. In some implementations, whenthe active profile is switched, one or more settings are automaticallyapplied to the smart streaming device, such as automatically increasingor decreasing a brightness of a display of the smart streaming device.

In some implementations, the process 730 can request further log-ininformation for the identified user. For example, a recognized user canbe prompted to enter a security pin or password to log in to the profileof the user. After proper log-in information is received and the user isrecognized, the active profile of the smart streaming device isswitched.

FIG. 7E is a flow diagram illustrating a process 740 used in someimplementations for determining an intended device for a command basedon a position of a UWB remote device (e.g., UWB remote device 250).

The process 740 determines the position of the UWB remote device as inblock 702 of FIG. 7A and then may optionally wait for a triggeringcondition to occur such as in decision block 704 of FIG. 7A.

At block 742 and, where block 704 is performed, in response to thetriggering condition occurring, the process 740 receives a command fromthe UWB remote device. The command can be routable to multiple devices.For example, certain commands, such as an increase volume, decreasevolume, power on/off, etc., can be applicable to more than one device(e.g., a smart streaming device, an associated television the smartstreaming device controls, an alternate media player, etc.). The process740, as described below, can select which device the command is intendedfor, and then route the command to the intended device.

At block 744, the process 740 determines the intended device for thecommand based at least partly on the position of the UWB remote device.In some implementations, the process 740 determines that the intendeddevice for the command is the device closest to the UWB remote device(e.g., the device with the shortest distance measurement to the UWBremote device). In other implementations, the process 740 can use boththe distance and the angle of arrival to determine if the user ispointing the UWB device at a particular other device. In someimplementations, this can be determined with an initial calibrationprocess where a user is instructed to point the UWB device (one or moretimes from different angles) at each of the devices the UWB device maycontrol. The inputs from this calibration process allow process 740 tomap these devices into a 3D space, such that the future position andorientation information gathered at block 702 can be correlated todetermine at which of the devices the UWB device is pointed.Alternatively, mathematical transforms can be determined for comparingthe positions specified in the calibration process with the currentposition and direction of the UWB device to determine if they match.

At block 746, the process 740 routes the command to the intended devicedetermined at block 744. In some implementations, after the command isrouted to the intended device, the command is executed on the intendeddevice.

FIG. 7F is a conceptual diagram 750 illustrating a selection of anintended device for a command according to some implementations of theinvention. In the diagram 750, the UWB remote device 250 is in proximityto devices 755, 756, 757, and 758 (referred to as “devices 755-758”). Asdescribed above with regards to FIG. 7E, a position of the UWB remotedevice 250 can be determined by the a UWB receiver on one of devices755-758 (in this case by device 755). From an initial calibrationprocess, the positions of each of the devices 756-758 was determined.The direction 759 of the UWB device 250 is determined and matched to theposition of device 757. Device 757 is thus determined as the intendeddevice. A command (in this case a power on command), issued by the UWBremote device 250, is routed to the device 757. In some implementations,the command is communicated to the device 757 via a UWB connection tothe intended device 757. In other implementations, the command receivedby the device 755 with a UWB receiver and the device forwards thecommand to the intended device 755 or sends an alternate command to thedevice 755 causing the command from the UWB device 250 to be implementedby the intended device 757. For example, the device 755 can use a HDMIconsumer electronics control (HDMI-CEC) connection to power-on, setinput source, etc. for the intended device 757.

FIG. 8 is a flow diagram illustrating a process 800 used in someimplementations for controlling an activation of an antenna of the UWBremote device (e.g., UWB remote device 250). The UWB remote devicecommunicates with a smart streaming device (such as one of the clientcomputing devices 205). In some implementations, process 800 can beperformed “just in time,” e.g. as a response to a user input on the UWBremote. In other implementations, the process 800 begins when the UWBremote device is activated, and sits idle or “in the background” until atriggering event, such as the UWB remote coming within a thresholddistance of the smart streaming device, occurs. When the triggeringevent occurs, the process 800 executes.

At block 802, the process 800 determines a position of the UWB remotedevice. UWB technology allows for the smart streaming device todetermine the position of the UWB remote device by determining adistance between the smart streaming device and the UWB remote deviceand an angle of arrival between the smart streaming device and the UWBremote device. Using the distance and the angle of arrival, a positionof the UWB remote device is determined.

At block 804, the process 800 determines a transmitting antenna of theUWB remote device that is closest to the smart streaming device. Forexample, the UWB remote device can have one more antennas located atvarious locations within the UWB remote device or on an exterior portionof the UWB remote device. Based on the distance between the UWB remotedevice and the receiving smart streaming device, the process 800 candetermine which of the antennas of the UWB remote device is closest tothe receiving smart streaming device. In some implementations, inaddition to using the position of the UWB remote device, the process 800may also use a signal strength between each antenna of the one or moreantennas and the receiving smart streaming device to determine which ofthe antennas is closest to the receiving smart streaming device. Inother implementations, the process 800 can use an angle of arrivalmeasurement at the receiving smart streaming device to determine whichantenna of the UWB remote device has the shortest line-of-sight to thereceiving smart streaming device.

At block 806, the process 800 enables the determined antenna anddisables the other antenna(s) on the UWB remote device. Because morethan one antenna transmitting at a time may cause interference incommunications between the UWB remote device and the receiving smartstreaming device, such as a blockage, the closest antenna is determinedand used to communicate with the receiving smart streaming device whilethe other antenna(s) of the UWB remote device are disabled to ensurethat a high quality signal is sent to the receiving smart streamingdevice.

FIG. 9 is a flow diagram illustrating a process 900 used in someimplementations for configuring a smart streaming device based on aposition of the UWB remote device (e.g., UWB remote device 250). The UWBremote device communicates with a smart streaming device (such as one ofthe client computing devices 205). In some implementations, process 900can be performed “just in time,” e.g. as a response to a user input onthe UWB remote. In other implementations, the process 900 begins whenthe smart streaming device is activated, and sits idle or “in thebackground” until a triggering event, such as the UWB remote comingwithin a threshold distance of the smart streaming device, occurs. Whenthe triggering event occurs, the process 900 executes.

At block 902, the process 900 determines a position of the UWB remotedevice. UWB technology allows for the smart streaming device todetermine the position of the UWB remote device by determining adistance between the smart streaming device and the UWB remote deviceand an angle between the smart streaming device and the UWB remotedevice. Using the distance and the angle, a position of the UWB remotedevice is determined. In some implementations, the position can bedetermined as a directed position (e.g., a static position within theroom). In other implementations, the position can be determinedcontinuously.

At block 904, the process 900 sets a configuration of the smartstreaming device based on the position of the UWB remote device. In oneimplementation, the process 900 sets the configuration by receiving oneor more inputs from the UWB remote device to calibrate the UWB remotedevice for the smart streaming device. During calibration, determiningthe position of the UWB remote device allows the process 900 todetermine an offset between the position of the smart streaming deviceand the position of the display, which can be a separate display deviceconnected to the to the smart streaming device.

To calibrate the smart streaming device, a user first moves the UWBremote device to point at a designated point (e.g., the center) of thedisplay, creating a “zero point” as a reference. The user then pointsthe UWB remote device at each corner of the display in turn. During thecalibration, the distance, the angle, and the elevation of the positionof the UWB remote device is compared to the zero point and/or each ofthe other corners. Based on the various position measurements, theprocess 900 can determine a location of the smart streaming devicerelative to the display, an offset based on the location of the smartstreaming device, and a size of the display. Once the offset isdetermined, the process 900 can use these measurements for accuratelyreceiving and interpreting commands from the UWB remote device. Forexample, a user of the UWB remote device can point at the display toperform different functions and have a cursor accurately appear on thedisplay (e.g., where the user is intending to point the UWB remotedevice), even though the smart streaming device is not located at thecenter of the display.

In another implementation, the smart streaming device may be calibratedto account for drift that can occur when remote movement is based onIMUs measurements of the UWB remote device. To account for this drift,the process 900 periodically determines the angle of the position of theUWB remote device to accurately get the UWB device position, which canthen be updated as the user moves the UWB device using further IMU data.

Several implementations of the disclosed technology are described abovein reference to the figures. The computing devices on which thedescribed technology may be implemented can include one or more centralprocessing units, memory, input devices (e.g., keyboard and pointingdevices), output devices (e.g., display devices), storage devices (e.g.,disk drives), and network devices (e.g., network interfaces). The memoryand storage devices are computer-readable storage media that can storeinstructions that implement at least portions of the describedtechnology. In addition, the data structures and message structures canbe stored or transmitted via a data transmission medium, such as asignal on a communications link. Various communications links can beused, such as the Internet, a local area network, a wide area network,or a point-to-point dial-up connection. Thus, computer-readable mediacan comprise computer-readable storage media (e.g., “non-transitory”media) and computer-readable transmission media.

Reference in this specification to “implementations” (e.g. “someimplementations,” “various implementations,” “one implementation,” “animplementation,” etc.) means that a particular feature, structure, orcharacteristic described in connection with the implementation isincluded in at least one implementation of the disclosure. Theappearances of these phrases in various places in the specification arenot necessarily all referring to the same implementation, nor areseparate or alternative implementations mutually exclusive of otherimplementations. Moreover, various features are described which may beexhibited by some implementations and not by others. Similarly, variousrequirements are described which may be requirements for someimplementations but not for other implementations.

As used herein, being above a threshold means that a value for an itemunder comparison is above a specified other value, that an item undercomparison is among a certain specified number of items with the largestvalue, or that an item under comparison has a value within a specifiedtop percentage value. As used herein, being below a threshold means thata value for an item under comparison is below a specified other value,that an item under comparison is among a certain specified number ofitems with the smallest value, or that an item under comparison has avalue within a specified bottom percentage value. As used herein, beingwithin a threshold means that a value for an item under comparison isbetween two specified other values, that an item under comparison isamong a middle specified number of items, or that an item undercomparison has a value within a middle specified percentage range.Relative terms, such as high or unimportant, when not otherwise defined,can be understood as assigning a value and determining how that valuecompares to an established threshold. For example, the phrase “selectinga fast connection” can be understood to mean selecting a connection thathas a value assigned corresponding to its connection speed that is abovea threshold.

As used herein, the word “or” refers to any possible permutation of aset of items. For example, the phrase “A, B, or C” refers to at leastone of A, B, C, or any combination thereof, such as any of: A; B; C; Aand B; A and C; B and C; A, B, and C; or multiple of any item such as Aand A; B, B, and C; A, A, B, C, and C; etc.

Although the subject matter has been described in language specific tostructural features and/or methodological acts, it is to be understoodthat the subject matter defined in the appended claims is notnecessarily limited to the specific features or acts described above.Specific embodiments and implementations have been described herein forpurposes of illustration, but various modifications can be made withoutdeviating from the scope of the embodiments and implementations. Thespecific features and acts described above are disclosed as exampleforms of implementing the claims that follow. Accordingly, theembodiments and implementations are not limited except as by theappended claims.

Any patents, patent applications, and other references noted above areincorporated herein by reference. Aspects can be modified, if necessary,to employ the systems, functions, and concepts of the various referencesdescribed above to provide yet further implementations. If statements orsubject matter in a document incorporated by reference conflicts withstatements or subject matter of this application, then this applicationshall control.

1. A method for controlling a smart streaming device, the methodcomprising: receiving a position of an ultra-wideband (UWB) device, andbased on the position of the UWB device, conducting a service event forthe smart streaming device, wherein the service event comprises one ormore of: image-based profile switching comprising: A) determining, basedon the position, a portion of an image that is less than the whole imageand that, wherein the selected portion of the image is selected based onthe position of the UWB device, is expected to depict a user in controlof the UWB device, B) recognizing a user depicted in the portion of theimage by providing a representation of the portion of the image to amachine learning system trained to perform user recognition, and C) inresponse switching an active profile of the smart streaming device to aprofile of the recognized user, or selective command routing comprising:D) identifying, based on the position, an intended recipient device,from among the smart streaming device or of one or more devicesconnected to the smart streaming device, at which the UWB device ispointed, E) selecting, by an intermediary device other than the UWBdevice, a signal corresponding to i) the recipient device and ii) acommand initiated from the UWB device for the intended recipient device,and F) in response routing, by the intermediary device, the signal tothe intended recipient device.
 2. The method of claim 1, wherein theposition of the ultra-wideband device is based on a determined angle ofarrival of a signal for the UWB device.
 3. (canceled)
 4. (canceled) 5.(canceled)
 6. The method of claim 1, wherein the service event comprisesthe image-based profile switching including the A) determining, based onthe position, the portion of the image that is less than the whole imageand that, wherein the selected portion of the image is selected based onthe position of the UWB device, is expected to depict the user incontrol of the UWB device, B) recognizing the user depicted in theportion of the image by providing the representation of the portion ofthe image to the machine learning system trained to perform userrecognition, and C) in response switching the active profile of thesmart streaming device to the profile of the recognized user.
 7. Themethod of claim 1, wherein the service event comprises the selectivecommand routing including the D) identifying, based on the position, anintended recipient device, from among the smart streaming device or ofone or more devices connected to the smart streaming device, at whichthe UWB device is pointed, E) selecting, by an intermediary device otherthan the UWB device, a signal corresponding to i) the recipient deviceand ii) a command initiated from the UWB device for the intendedrecipient device, and F) in response routing, by the intermediarydevice, the signal to the intended recipient device; and wherein thecommand indicates to activate or deactivate the intended recipientdevice.
 8. A non-transitory computer-readable storage medium storinginstructions that, when executed by one or more processors, cause acomputing system to execute a process, the process comprising: receivinga position of an ultra-wideband (UWB) device, and based on the positionof the UWB device, conducting a service event for the smart streamingdevice, wherein the service event comprises one or more of: image-basedprofile switching comprising: A) determining, based on the position, aportion of an image that is less than the whole image and that, whereinthe selected portion of the image is selected based on the position ofthe UWB device, is expected to depict a user in control of the UWBdevice, B) recognizing a user depicted in the portion of the image byproviding a representation of the portion of the image to a machinelearning system trained to perform user recognition, and C) in responseswitching an active profile of the smart streaming device to a profileof the recognized user, or selective command routing comprising: D)identifying, based on the position, an intended recipient device, fromamong the smart streaming device or of one or more devices connected tothe smart streaming device, at which the UWB device is pointed, E)selecting, by an intermediary device other than the UWB device, a signalcorresponding to i) the recipient device and ii) a command initiatedfrom the UWB device for the intended recipient device, and F) inresponse routing, by the intermediary device, the signal to the intendedrecipient device.
 9. The non-transitory computer-readable storage mediumof claim 8, wherein the position of the ultra-wideband device is basedon a determined angle of arrival of a signal for the UWB device. 10.(canceled)
 11. The non-transitory computer-readable storage medium ofclaim 8, wherein the service event comprises the image-based profileswitching including the A) determining, based on the position, theportion of the image that is less than the whole image and that, whereinthe selected portion of the image is selected based on the position ofthe UWB device, is expected to depict the user in control of the UWBdevice, B) recognizing the user depicted in the portion of the image byproviding the representation of the portion of the image to the machinelearning system trained to perform user recognition, and C) in responseswitching the active profile of the smart streaming device to theprofile of the recognized user.
 12. The non-transitory computer-readablestorage medium of claim 8, wherein the service event comprises theselective command routing including the D) identifying, based on theposition, an intended recipient device, from among the smart streamingdevice or of one or more devices connected to the smart streamingdevice, at which the UWB device is pointed, E) selecting, by anintermediary device other than the UWB device, a signal corresponding toi) the recipient device and ii) a command initiated from the UWB devicefor the intended recipient device, and F) in response routing, by theintermediary device, the signal to the intended recipient device. 13.The non-transitory computer-readable storage medium of claim 12, whereinthe command indicates to activate or deactivate the intended recipientdevice or change a volume of the intended recipient device.
 14. Acomputing system for controlling an smart streaming device, thecomputing system comprising: an ultra-wideband device; and a smartstreaming device, the smart streaming device configured to perform aprocess, the process comprising: receiving a position of anultra-wideband (UWB) device, and based on the position of the UWBdevice, conducting a service event for the smart streaming device,wherein the service event comprises one or more of: image-based profileswitching comprising: A) determining, based on the position, a portionof an image that is less than the whole image and that, wherein theselected portion of the image is selected based on the position of theUWB device, is expected to depict a user in control of the UWB device,B) recognizing a user depicted in the portion of the image by providinga representation of the portion of the image to a machine learningsystem trained to perform user recognition, and C) in response switchingan active profile of the smart streaming device to a profile of therecognized user, or selective command routing comprising: D)identifying, based on the position, an intended recipient device, fromamong the smart streaming device or of one or more devices connected tothe smart streaming device, at which the UWB device is pointed, E)selecting, by an intermediary device other than the UWB device, a signalcorresponding to i) the recipient device and ii) a command initiatedfrom the UWB device for the intended recipient device, and F) inresponse routing, by the intermediary device, the signal to the intendedrecipient device.
 15. The computing system of claim 14, wherein theposition of the ultra-wideband device is based on a determined angle ofarrival of a signal for the UWB device.
 16. (canceled)
 17. (canceled)18. (canceled)
 19. The computing system of claim 14, wherein the serviceevent comprises the image-based profile switching including the A)determining, based on the position, the portion of the image that isless than the whole image and that, wherein the selected portion of theimage is selected based on the position of the UWB device, is expectedto depict the user in control of the UWB device, B) recognizing the userdepicted in the portion of the image by providing the representation ofthe portion of the image to the machine learning system trained toperform user recognition, and C) in response switching the activeprofile of the smart streaming device to the profile of the recognizeduser.
 20. The computing system of claim 14, wherein the service eventcomprises the selective command routing including the D) identifying,based on the position, an intended recipient device, from among thesmart streaming device or of one or more devices connected to the smartstreaming device, at which the UWB device is pointed, E) selecting, byan intermediary device other than the UWB device, a signal correspondingto i) the recipient device and ii) a command initiated from the UWBdevice for the intended recipient device, and F) in response routing, bythe intermediary device, the signal to the intended recipient device.21. The computing system of claim 14, wherein the service eventcomprises the image-based profile switching and wherein the selecting ofthe portion of the image is performed prior to image recognition on theimage.
 22. The method of claim 1, wherein the service event comprisesthe image-based profile switching and wherein the selecting of theportion of the image is performed prior to image recognition on theimage.
 23. The non-transitory computer-readable storage medium of claim8, wherein the service event comprises the image-based profile switchingand wherein the selecting of the portion of the image is performed priorto image recognition on the image.